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and  the  service  times  are  exponentially  distributed. 

This  memo  also  contains  curves  of  mean  waiting  time, 
fraction  of  lost  tasks,  fraction  of  time  system  is  busy  and 
mean  busy  period  versus  traffic  intensity.  4 \ /* 


This  document  contoins  proprietory  information  of  the  General  Electric  Company  and  is  restricted  to 
distribution  ond  use  within  the  General  Electric  Compony  unless  designated  above  os  GE  Clots  1 or 
unless  otherwise  expressly  authorised  in  writing. 


GE 

Class 

1 

Govt 

Class 

Unclassified 

V 


■ rj-  "F  '■rr* 


c / r*  .r-> 


rTTr^^r7 


T1 


GENERAL  ELECTRIC  COMPANY  TECHNICAL  INFORMATION 


Within  the  limitations  imposed  by  Government  data  export  regulations  and  security 
classifications,  the  availability  of  General  Electric  Company  technical  information 
is  regulated  by  the  following  classifications  in  order  to  safeguard  proprietary  infor- 
mation: 


CLASS  1:  GENERAL  INFORMATION 


Available  to  anyone  on  request  • 
Patent,  legal  and  commercial  review 
required  before  issue. 


CLASS  2:  GENERAL  COMPANY  INFORMATION 


Available  to  any  General  Electric  Company 
employee  on  request. 

Available  to  any  General  Electric  Subsidiary 
or  Licensee  subject  to  existing  agreements. 
Disclosure  outside  General  Electric  Company 
requires  approval  of  originating  component. 


CLASS  3:  LIMITED  AVAILABILITY  INFORMATION 


Original  Distribution  to  those  individuals  with 
specific  need  for  information. 

Subsequent  Company  availability  requires 
originating  component  approval. 

Disclosure  outside  General  Electric  Company 
requires  approval  of  originating  component . 


CLASS  4:  HIGHLY  RESTRICTED  DISTRIBUTION 


Original  distribution  to  those  individuals  person- 
ally responsible  for  the  Company's  interests  in 
the  subject. 

Copies  serially  numbered,  assigned  and  recorded 
by  name. 

Material  content,  and  knowledge  of  existence, 
restricted  to  copy  holder . 


GOVERNMENT  SECURITY  CLASSIFICATIONS,  when  required,  take  precedence 
in  the  handling  of  the  material.  Wherever  not  specifically  disallowed,  the  General 
Electric  classifications  should  also  be  included  in  order  to  obtain  proper  handling 
routines. 


i 

I 


] 

I I 
f j 


GENERAL  ELECTRIC  company 

HEAVY  MILITARY  EQUIPMENT  DEPARTMENT 

TECHNICAL  INFORMATION  SERIES 


SECTI0N  Information  Processing  Engineering 

Information  Systems  Development  Engineering 


HMED  ACCOUNTING  REFERENCE 


COLLABOnATQj 

y 

APPROVED l4^ 

Acting  for 


systems 


location  CSP  3,  Room  16 


Wengert 


R77EMH9 

MINIMUM  DISTRIBUTION  • Government  Unclossifiad  Motariol  (ond  Till*  Pages)  in  G.E.  Class*!  1,  2,  or  3 will  b«  the 
following. 


Copi*»  Till*  Pog*  Only 


Logoi  Section,  HMED  (Syrocus*) 

Monoger,  Tachnologi col  Plonmng,  HMED  (Syrocus*) 
G— E Tachnicol  Doto  Canlar  (Schenectody) 


MINIMUM  DISTRIBUTION  • Govarnmant  Clossifiad  Motariol,  Sacral  or  Confidential  in  G.E.  Classes  1,  2,  or  3 will  be 
the  following. 

1 1 Classified  Section,  Electronics  Pork  Library 

1 0 Monoger,  Technological  Planning,  HMED  (Syracuse) 

ADDITIONAL  DISTRIBUTION  (Keep  ot  minimum  within  intent  of  assigned  G.E.  Closs.) 


COPIES 


(CLASS  1 ONLY) 
1 


DEFENSE  DOCUMENTATI 

CENTER 
L.  I.  Chasen 

W.  Adams 
T.  Astemborski 

D.  Bahrs 
F.  Binder 

C.  Blom 
J.  Breyer 
J.  Buchta 

E.  Cabaniss 
J . Chiasson 

F.  DeBritz 

O.  Golubjatnikov 
V.  Grosso 
J.F.  Jones 

G.  Kascha 

L.  Knickerbocker 

M.  McCormack 
E.  McCrohan 

D.  Mott 


LOCATION 

CAMERON  STATION, 
ALEXANDRIA,  VA.  22314 
P.  O.  Box  8555 
Philadelphia,  Pa. , 19101 

CSP4-48 

FRP1-F3 

CSP3-16 

FRP1-F3 

CSP5-M8 

FRP1-F2 

CSP4-58 

FRP1-K7 

CSP3-15 

FRP1-J7 

FRP1-J7 

CSP3-16 

CSP5-K7 

CSP3-16 

FRP1-N1 

CSP3-16 

CSP3-16 

CSP3-16 


HMED  AO 24  REV  l/7/75 


Copies 

Name 

Location 

1 

K.  Olsen 

CSP4-57 

1 

S.  Parks 

FRP1-57 

1 

P.  Schuls 

FRP1-F3 

1 

O.  Shuart 

CSP4-38B 

1 

R.  Talham 

FRP1-A5 

1 

F.  Teillon 

CSP5-K7 

1 

B.  Viglietta 

CSP4-57 

1 

R.  Wengert 

CSP3-16 

50 

G.  Arabadjis  (Class) 

CSP3-16 

w 


TABLE  OF  CONTENTS 

Section 

Title 

Page 

I 

INTRODUCTION 

1-1 

II 

THE  MODEL 

2-1 

III 

STATE  PROBABILITIES 

3-1 

IV 

MEAN  NUMBER  OF  TASKS 

4-1 

V 

THROUGHPUT,  WAITING  TIME  AND  RESPONSE  TIME 

5-1 

VI 

LOST  TASKS 

6-1 

VII 

BUSY  PERIOD 

7-1 

VIII 

TASK  PARTITIONING  AND  SPAWNING 

8-1 

lACCESSUN  1#r  . 

|nt|S  Whit*  $ectl*i  ft 

| p liift  Sect i*o  □ 

o 

; $ • : ' . ..  

r.y 

* COOES 

' SfuCIAL 

1 ] 

• ■ g.v 


LIST  OF  ILLUSTRATIONS 


Figure 

Title 

Page 

2-1 

The  System 

2-1 

5-1 

Mean  Waiting  Time  VS  Traffic  Intensity 

5-2 

6-1 

Fraction  of  Lost  Tasks;  q/s  = 1 

6-2 

6-2 

Fraction  of  Lost  Tasks;  q/s  = 2 

6-3 

6-3 

Fraction  of  Lost  Tasks  Vs  Queue  Capacity;  a = 0 

6-4 

6-4 

Fraction  of  Lost  Tasks  Vs  Queue  Capacity;  a = 0.9 

6-5 

7-1 

Fraction  of  Time  System  is  Busy  Vs  Fraction  Busy  Servers 

7-2 

7-2 

Mean  Busy  Period;  q/s  =0.1 

7-4 

7-3 

Mean  Busy  Period;  q/s  = 1.0 

7-5 

7-4 

Mean  Busy  Period;  q/s  = 10 

7-6 

SECTION  I 
INTRODUCTION 


Reference  1 describes  a multimicroprocessor  architecture  which  consists  of  several 

1 parallel  processors  fed  by  a common  queue.  That  paper  also  contains  a performance 

analysis  of  the  system's  queueing  behavior  using  an  Idealized  model.  This  report  contains 
an  elaboration  of  that  analysis  for  readers  Interested  In  the  analytical  details. 


SECTION  II 
THE  MODEL 


The  queueing  model  Is  shown  In  Figure  2-1.  It  consists  of  s parallel  processors 
(or  servers)  fed  by  a common  queue  which  can  accommodate  up  to  q tasks  (q  is  called 
the  capacity  of  the  queue).  A task,  when  assigned  to  a server,  is  serviced  to  completion. 
Service  time  is  assumed  to  be  exponentially  distributed  with  a mean  of  l/pQ  seconds, 
where  nQ  is  called  the  service  rate.  Upon  completion  of  service,  the  task  is  released 
and  the  server  Instantaneously  takes  the  next  task  in  the  queue  to  process . If  the  queue  is 
empty,  the  server  becomes  idle.  A completed  task  may  leave  the  system  or,  with  probabi- 
lity a,  spawn  another  task  which  then  instantaneously  goes  to  the  end  of  the  queue  as  shown 
by  the  feedback  path  in  Figure  2-1. 


LOST  TVSKS 


s SERVERS 
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Figure  2-1. 


The  System 


R 


If  any  task  encounters  a full  queue,  it  becomes  lost.  The  probability  of  a spawned 
task  becoming  lost  is  virtually  zero  since  when  the  parent  task  completes  service  the 
server  is  released  and  a new  task  from  the  queue  is  instantaneously  put  into  service. 
Thus,  the  spawning  is  synchronized  with  the  decrease  in  queue  size  and  the  spawned  task 
will  almost  always  find  at  least  one  empty  place  in  the  queue.  The  probability  that  an 
external  task  arrives  in  the  same  time  increment  At  as  a spawned  task  is  vanishingly 
small  in  this  model. 
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The  external  arrivals  to  the  system  are  assumed  to  be  Poisson  distributed  with  a 
mean  arrival  rate  of  Xq  arrivals/second.  The  average  number  of  tasks  processed  per 
second  by  the  servers  is  X (the  throughput),  and  Xct  Is  the  feedback  arrival  rate.  Thus,  the 
sum  of  the  external  and  feedback  arrivals,  Xq  + Xcr,  is  the  total  task  rate  coming  to  the  sys- 
tem. Since  X arrivals /second  enter  the  queue,  it  follows  that  the  rate  at  which  tasks  are 
lost  is  Xq  + Xcr  - X tasks  per  second.  The  quantities  Xq,  hq  and  a are  assumed  to  be  known. 

The  queue  mechanism  described  above  implies  that  If  one  or  more  servers  are  idle 
then  the  queue  must  be  empty.  Conversely,  if  the  queue  is  not  empty  then  alt  servers  must 
be  busy.  Since  a full  system  consists  of  q tasks  in  the  queue  and  s tasks  in  service  (i.e. , 
all  servers  busy),  the  capacity  of  the  system  is: 

n = s + q (2-1) 

On  the  average,  the  s servers  can  complete  at  most  jxqs  tasks  per  second.  Therefore 
the  average  throughput  X cannot  exceed  this  bound: 

X < /i  s (2-2) 

o 

This  will  be  n Section  IV.  It  will  be  convenient  in  the  following  development  to 

introduce  t traffic  intensity  defined  as: 

_ o 

"o  (1  -a) 

and  the  traffic  intensity  per  server  defined  as: 

r X 

= ° = o 

po  s ^qs(1-ct) 


(2-3) 


(2-4) 
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SECTION  in 


STATE  PROBABILITIES 


Queueing  models  with  Poisson  arrivals  and  exponential  service  time  are  about  the 
simplest  queues  to  analyze.  Kletnrock's  book  (Ref.  2),  Chapter  3,  contains  a readable 
exposition  of  different  queueing  models  of  this  type.  These  are  all  referred  to  as  M/M 
queues.  The  first  "M"  Indicates  that  the  arrival  distribution  is  Poisson  or,  equivalently, 
that  the  interarrival  time  between  two  successive  arrivals  Is  exponentially  distributed. 

The  second  "M"  denotes  that  the  service  time  Is  exponentially  distributed.  A queueing  sys- 
tem with  s parallel  servers  and  queue  capacity  q Is  denoted  as  an  M/M/s/q  queue.  In  this 
report,  reference  will  be  made  to  s/q  queues  as  shorthand  for  M/M/s/q. 


Let  N(t)  denote  the  number  of  tasks  in  the  system  at  time  t.  Similarly,  let  N^(t) 


and  N (t)  denote  respectively  the  number  of  tasks  in  queue  and  the  number  of  tasks  In 
s 


service  at  time  t.  Then: 


N(t)  = N (t)  + N (t) 
s q 


Ns(t)  = { 


N(t)  for  0 < N(t)  s 
s for  s N(t)  s n 


0 

N (t)  = < 

q In 


0 for  0 < N(t)  < s 

N(t)-s  for  s < N(t)  n 


Now  define: 


Pk(t)  = P { N (t)  =k  } , 


the  probability  that  there  are  k tasks  in  the  system  at  time  t.  There  are  three  ways  in 
which  the  system  can  be  in  state  k at  time  t + At: 


1.  The  system  was  in  state  k-1  at  time  t and  an  external  arrival  occurred  in  time 
At  with  probability  XgAt. 


2 . The  system  was  in  state  k + 1 at  time  t and  a task  in  service  completed  in 

time  At.  which  did  not  spawn  another  task.  This  occurs  with  probability 

XT  /l\..  /I  \ A i. 


Ns<t)M0(l  - cr)  At. 
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3.  The  system  was  in  state  k at  time  t and  no  task  left  or  arrived  to  the  system  in 

time  At,  or  a task  completed  service  and  spawned  another  task.  This  occurs 

with  probability  1 - \ At  - N (t)p  (1  - a)  At. 

o so 

The  equations  which  describe  these  conditions  for  0 s k s n are: 
(t+  At)  = 

(1-  \q  At)  pQ(t)  + hq  (1-cr)  P2  (t)  At 

o 

II 

Vk-l(t)At  + [ 1-x0At-kM0d-(T)At]  pk(t)  +(k+l)M0(l^x)Pk+1(t)At 

/ 

0<k<s 

| V’k-l^1  + [ 1-X0At-sM0(l-cT)At]  pk(t)  +SMQ(l-<T)Pk+1(t)At 

s $ k < n 

\>Pn-l(t)At  + 1 1-s%(1-(T)At]  Pn(t) 

k = n 

Subtracting  P^(t)  from  both  sides  of  this  equation,  dividing  by  At,  taking  the 
limit  At-*-0,  and  letting 


P^t)  = lim 
At-*-0 


Pk(t+At)  -p^t) 
At 


we  obtain: 


■x0  PQ  (t)  +Mo(l-a)p1(t) 

k = 0 

\>Pk-l(t)~[Vkpo(1_CT)] 

Pk(t)  +(k  + l)^Q(l-a)pk  + 1(t) 

0<k<  s 

XoPk-l(t)  " [ Vspo(1_(T)] 

pk  (f)  +s^o(1“CT)Pk  + l(t) 

s < k<  n 

XoVl(t)  -8/i0d-o)pn(t) 

k = n 

(3-5) 


This  is  a set  of  n + 1 simultaneous  linear  differential -difference  equations  whose  solution 
is  quite  complex.  The  steady-state  or  equilibrium  solution  can  be  easily  obtained,  however, 
by  setting  p^t)  =0  and  solving  the  resultant  difference  equations: 


Vo  * Pl 

,ro+k)pk=roVl+|k+1>  Vl 
,ro+s)pk'Vk-l+BPk+l 


0<  k<  s 

(3-6) 

sjk<n 


sp  = r p , 
n o *n-l 
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These  n + 1 equations  are  not  all  Independent  however  since  any  one  can  be  derived  from 
the  remaining  n equations . To  obtain  the  unique  solution  we  need  the  normalization 
condition 


£ Pk  = 1 
k = 0 


which  arises  because  the  p^s  are  probabilities  of  mutually  exclusive  events. 
The  solution  to  these  equations  is  easily  found  by  Induction  to  be: 


= \ 


k ! 


0<  k<  s 


v k_s  , P° 

V o o' 


s < k < n 


s s: 


where: 


Po  = 


r 

_ 

■") 

s k s +1 

1 r r 

/ Y"  o o 

1 

\ *-•  k s l (s  - r ) 

k=0 

1 \s) 

J 

-1 


(3-7) 


(3-8) 


(3-9) 


p is  the  probability  that  the  system  is  empty;  pr  is  the  probability  that  the  system  is  full. 
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SECTION  IV 

MEAN  NUMBER  OF  TASKS 


From  the  state  probabilities  several  Interesting  quantities  can  be  found.  The  mean 
number  of  tasks  in  the  system  is: 


N = Z)  kPk  = Na  + Na 
k=0  k q s 


(4-1) 


where  N and  N are  the  mean  number  of  tasks  In  queue,  and  the  mean  number  In  service, 
q s 

respectively.  These  are  given  by: 


N = X)  (k-s)p, 
3 k = s + 1 K 


(4-2) 


s n 

N = XI  kft  + s L Pu 
3 k =0  K k =s  + 1 K 


(4-3) 
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SECTION  V 


THROUGHPUT,  WAITING  TIME  AND  RESPONSE  TIME 


The  throughput,  X is  the  mean  number  of  tasks  serviced  per  second,  which  is  simply: 

X=poNs  (5-D 

Since  the  mean  number  in  service,  N , cannot  exceed  the  number  of  servers,  the 

s 

throughput  inequality  given  by  Equation  2-2  Is  proved. 

The  mean  response  tlm'j  T is  the  average  time  it  takes  a task  to  go  through  the 
system.  T Is  composed  of  the  wait  time  in  queue,  W,  and  the  service  time  l/pQ; 

T = W + — 1—  (5-2) 

Mo 

T can  be  found  from  Little's  theorem  (Ref.  2).  On  the  average,  an  arriving  task 
should  find  the  same  number  of  tasks  (N)  in  the  system  as  it  leaves  behind  upon  departure. 
The  latter  is  merely  the  throughput  X times  T,  so  that: 


H N 
^o  s 

Figure  5-1  shows  plots  of  the  normalized  waiting  time 
N 

w = =?  (5-4) 

° N 

s 

for  various  values  of  q and  s versus  pQ.  The  designator  with  each  curve  indicates  the 
value  of  s and  q,  e.g.,  4/8  indicates  a four-server  system  with  a queue  capacity  of  eight. 
The  normalized  response  time,  pqT,  can  be  obtained  from  these  curves  by  adding  one  (see 
Equation  5-2)  ).  Note  that  increasing  q and  s such  that  their  ratio  q/s  remains  constant 
has  the  effect  of  reducing  the  response  time  for  small  p and  increasing  the  response  time 
for  pQ  moderately  larger  than  unity.  This  increase  occurs  because  relatively  fewer  tasks 
get  lost  as  the  queue  capacity  is  proportionately  increased. 

For  small  pQ  the  curves  approach  straight  lines  on  log-log  paper.  Furthermore,  for 
given  s,  all  curves  approach  the  same  straight  line  independent  of  q.  Intuitively  this  is  not 
surprising  since  at  low  traffic  intensities  the  queue  is  almost  never  full  when  a task  arrives. 
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It  is  not  difficult  to  derive  an  approximate  expression  for  the  waiting  time  valid  for  low 
traffic  intensities.  From  equations  (4—2) , (4-3)  and  (5-4)  we  have 


s+1 


+ 2 Ps+2  + V + 3P- 


n 


u W = — 

° Pj  +2  p2  + ...  +sps  + s(ps+1  + ...  +pn) 


For  small  pQ,  p^  decreases  rapidly  with  Increasing  k.  Therefore  taking  only  the 
first  terms  in  the  numerator  and  denominator  above  yields  (using  Equation  (3-8)  ) 


p W * 
o p 


s+1 


_ S+1 
r p 
o o 

s . s r 


r p 
0*0 


r 8 
_o 

8 • S '. 


.s!!1  . a 
s'.  Po 


For  small  p. 


(5-5) 


For  large  pQ  the  curves  approach  a plateau  whose  value  depends  only  on  the 
ratio  q/s . In  fact 


p W « — For  large  pn  (5-6) 

s o 

Intuitively  this  result  is  reasonable.  Under  high  traffic  conditions  an  arriving  task  that 

joins  the  queue  will  find  q-1  tasks  in  queue  and  s tasks  in  service.  On  the  average  it 

will  take  the  s parallel  servers  q/sp  seconds  to  perform  this  work,  hence  Equation 

(5-6)  follows. 
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SECTION  VI 
LOST  TASKS 


From  Figure  2-1,  the  total  task  arrival  rate  to  the  queue  (external  and  feedback 
arrivals  is  Xq  + Xcr.  The  rate  at  which  the  tasks  enter  the  system  (i.e.,  become  admitted 
to  the  queue)  is  X,  the  throughput.  Therefore,  the  rate  at  which  tasks  become  lost  is  the 
difference  between  the  input  and  throughput  arrival  rates,  Xq  + Xcr-  X.  Let  L be  the  fraction 
of  lost  tasks : 

X - X(l-o-)  (6-1) 

L = -2 

X + Xcr 
o 

Using  Equations  (2-3)  and  (5-1)  this  becomes 


(1  - cr)  (r  -N  ) 
v o s 

(1  - cr)  r + cr  N 
' ' o s 


(6-2) 


Figures  6-1  and  6-2  show  plots  of  the  percentage  of  lost  tasks  versus  the  per  processor  traf- 
fic intensity  pQ.  Figure  6-1  is  for  the  case  q = s and  Figure  6-2  is  for  the  case  q = 2s  for 
various  values  of  s and  a . Figures  6-3  and  6-4  show  plots  of  L versus  the  queue  capacity 
q for  various  values  of  s at  a = 0 and  cr  = 0.9. 

A response  time  u T « 1 for  values  of  p up  to  0.6  implies  that  a server  is  nearly 
o o 

always  available  to  service  the  next  incoming  task.  At  traffic  intensities  above  pQ  = 0.6, 
the  effects  of  queueing  tasks  become  important  very  rapidly  and  the  percentage  of  lost 
tasks  (L)  becomes  high.  Figure  6-3  shows  that  L is  very  sensitive  to  queue  capacity.  For 
example,  increasing  q from  5 to  8 (at  pQ  = 0.5)  reduces  the  loss  rate  by  an  order  of 
magnitude. 

It  is  also  interesting  to  note  the  behavior  of  the  lost  task  percentage  with  spawn 
probability  cr.  Keeping  other  parameters  constant,  increasing  the  spawn  probability 
substantially  decreases  the  percentage  loss.  The  reason  for  this  decrease  of  task  loss 
with  increasing  a is  primarily  due  to  the  assumed  characteristics  of  the  queueing  model. 

As  discussed  earlier,  a spawned  task  is  synchronized  with  a decrease  in  queue  size  and  thus 
is  seldom  lost. 
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Figure  6-2.  Fraction  of  Lost  Tasks;  q/s  = 2 


r 


,UW1  » ■■  « * » » * ■ * ■■  ■ ■■  ■ ■■  ■ ■ ■ ■ 

0 1 2 3 4 5 6 7 8 9 10  11  12  13  1 

q QUEUE  CAPACITY 


Figure  6-3.  Fraction  of  Lost  Tasks  Vs  Queue  Capacity;  <j  = 0 
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Figure  6-4.  Fraction  of  Lost  Tasks  Vs  Queue  Capacity;  a = 0.9 
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SECTION  VII 
BUSY  PERIOD 

The  system  is  called  idle  if  no  task  is  in  service,  that  is,  if  all  servers  are  idle  — 
otherwise  the  system  is  called  busy.  The  system  passes  through  alternating  cycles  of  busy 
and  idle  periods.  A busy  period  commences  when  a task  arrives  at  an  idle  system  and  ends 
when  a completed  task  leaves  behind  an  idle  system. 

Let  B be  the  mean  duration  of  a busy  period  and  l be  the  mean  duration  of  an  idle 
period.  The  probability  that  the  system  is  idle  is  p , given  by  Equation  (3-9).  This  can 
also  be  interpreted  as  the  fraction  of  time  that  the  system  is  idle,  that  is 


Clearly 


n 

»-"o-  im  = k£  »k  <7-2> 

is  the  probability  that  the  system  is  busy  (i.e. , not  in  the  idle  state)  and  thus  the  fraction 
of  time  that  the  system  is  busy. 

Simply  because  the  system  is  busy  does  not  imply  that  all  the  servers  are  busy.  In 
fact  it  just  takes  one  server  busy  in  order  for  the  system  to  be  busy.  A measure  of  the 
server  utilization  is  the  fraction  of  busy  servers,  N_/s.  Figure  7-1  shows  a plot  of  the 
fraction  of  time  the  system  is  busy  versus  the  fraction  of  busy  servers  for  different 
numbers  of  servers.  As  can  be  seen  from  the  graphs,  for  lightly  loaded  systems  we  have 

N (small  N /s)  (7-3) 

s s 

is  the  mean  time  that  the  system  is  in  state  0.  This  is  merely 
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B + 1 w S ' s ' 


The  mean  idle  period 


(7-4) 
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This  may  then  be  substituted  into  Equation  (7-1)  and  solved  for  the  busy  period  B: 


b (‘ 

n ' 


and  normalizing  the  busy  period  with  respect  to  the  service  time  yields: 


-0“  ro(1-cr)  ^ pQ  J 
Pq  is  given  by  Equation  (3-9). 

Figures  7-2,  7-3,  and  7-4  show  plots  of  the  normalized  busy  period  pQB  versus 
the  traffic  intensity  per  server,  pQ.  Figure  7-2  shows  a family  of  curves  for  various 
values  of  queue  capacity  q and  number  of  servers  s for  queue  capacity  to  server  ratio 
q/s  = 0.1.  Similarly,  Figure  7-3  is  for  the  case  q/s  = 1 and  Figure  7-4  for  q/s  = 10. 

The  busy  period  will  now  be  derived  by  an  alternate  method  which  is  included  here 

for  interest.  It  uses  the  notion  of  an  imbedded  process.  The  random  process  N(t),  which 

is  the  number  of  tasks  in  the  system  at  time  t,  is  defined  on  a continuous  time  scale  and 

is,  in  fact,  a Markov  process.  A Markov  process  has  the  property  that  for  any  t > t^  > t2  > 

. . . t and  m 1 
m 


P rN(t)  | Ndj),  N(t2)...N(tm)}  = p rN(t)|  N(tx) } 


As  time  progresses  the  system  moves  from  one  state  to  another.  Upon  arrival  of 
a task  the  system  moves  from  state  k to  k + 1;  upon  departure  it  moves  from  k to  k - 1. 

Each  time  the  process  enters  a state,  it  remains  in  that  state  for  a period  of  time  (which 
is  random)  and  then  moves  to  a neighboring  state.  It  is  not  difficult  to  show  that  the  time  the 
process  resides  in  a state  before  moving  out  of  it  is  exponentially  distributed.  The  mean 
time  is  state  k,  denoted  by  r^,  is  the  reciprocal  of  the  exit  rates  from  that  state.  For 
example  if  0 < k $ s then  all  k tasks  are  in  service  and  none  in  queue . The  departure  from 
state  k occurs  either  by  a new  arrival  to  the  system  (rate  Aq)  or  by  completion  of  a non- 
spawning  task  service  (rate  kpQ  (1  - a)  ). 
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Thus,  the  mean  time  in  state  k is 
r 

1 1 

X p 

o o 


rQ(l-a) 


Tk  = < 


X +kp  (1-a) 
o o ' 


Xo+s/io(1-a) 


8Mo(l-CT) 


(rQ  +k)  (1  -a) 


% (r0+s)  (i-cr) 


Mq  s(l -cr) 


k = 0 

0 < k i s 

s < k < n 
k = n 


(7-8) 


No'.v  we  consider  the  system  at  its  transition  points  when  it  changes  state.  Let  N. 
be  the  state  the  system  enters  at  the  i^  transition.  If  the  i^1  transition  occurs  at  time 
t.  then  clearly 

N.  = N(t.) 

1 v 


Let  * km  be  the  transition  probability  that  the  system  will  enter  state  k given  it  was  in 
state  m at  the  previous  transition: 


"km  = P (N.  =k  | N.  _ j = m ) 


(7-9) 


Clearly  7rkm  is  the  exit  flow  rate  from  m to  k divided  by  the  total  flow  rate  out  of 
state  m,  i.e. : 

1 k = 0 


'k+1, k 


■< 


X +k  p (1  - cr) 
o o ' ’ 


X +S|i  ( 1 - cr) 
o o'  ’ 


r +k 
o 


r +s 
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0 < k < s 


s < k < n 


k = n 


(7-10) 
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T.  . 7T  . 
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Equation  (7-14)  is  not  difficult  to  derive.  Essentially,  it  says  that  the  mean  time  from 
first  entrance  to  state  m until  first  entrance  to  state  k is  the  mean  time  spent  in  state  m 
plus  the  mean  time  to  get  to  state  k from  the  state  the  system  goes  to  (state  j)  after  state  m, 
averaged  over  j.  Using  Equations  (7-10)  and  (7-11),  Equation  (7-10)  becomes: 


Tkm  Tm  + Tk,  m + ln  m + 1,  m + Tk,  m + 171-  m - 1,  m 


M m + 1 
k ^ m - 1 


- T + T , -IT  - 

m m + 1,  m-1  m - 1, m 


k = m + 1 


= T +T  , . , 7T  . , 

m m-1,  m + 1 m + 1,  m 


k = m - 1 


In  particular,  setting  k = 0,  we  find 


m v nn  _ HP 

1 0m  Tm  10,m  + l7rm  + l,m  0,m-l7rm-l,m 


m > 1 


T1  + T02  n 21 


m = 1 


T0  + T0l  *10 


m = 0 


To  solve  these  equations  for  the  busy  period  B = we  set  m = n and  obtain  (using 
Equations  (7-10)  and  (7-11)) 


T = t + T , 
on  n o,  n - 1 

This  equation  may  be  substituted  into  the  next  lower  index  equation  and  solved  for  Tq 
The  procedure,  performed  recursively,  yields  at  each  stage  an  equation  of  the  form 


Tok  “ \ + ^k  To,k - 1 


k / 1 


where 


a _ Tk+  *k  + l.k\  + 1 
k 1_7rk+l,k/3k+l 


k = 1 


k - l,k 


k 1-7 r 


k + l.k^k  + l 


and  starting  with 


^ n = 1 


Thus  the  solution  of  Equation  (7-16)  for  T is  obtained  by  evaluating  Equation  (7-19) 
recursively,  starting  with  Equation  (7-20),  obtaining  finally  the  mean  busy  period 


B “ T01  ~ al* 
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SECTION  VIII 

TASK  PARTITIONING  AND  SPAWNING 


The  application  for  which  this  analysis  was  performed  involved  a multi-microprocessor 
system  with  queue  memories.  The  servers  represent  processors  and  the  tasks  represeiu 
requests  for  processor  time.  The  spawning  feature  of  the  model  is  intended  to  reflect  the 
partitioning  of  a job  into  smaller  tasks.  The  definition  of  task  size  is  the  responsibility  of 
the  system  designer.  Should  the  system  be  designed  with  large  tasks  so  that  each  job,  once 
it  enters  the  server,  is  processed  to  completion  and  then  leaves  the  system;  or  should  tasks 
be  defined  small  so  that  upon  each  task  completion  the  job  may  have  to  rejoin  the  queue  and 
thus  continue  circulating  (i.e.,  spawning)  through  the  system  until  it  is  completed? 

Some  of  the  tradeoffs  are  clear.  Each  time  a task  circulates  through  the  system  it 
must  wait  in  queue  before  being  processed.  Therefore,  if  the  overhead  per  service  or  the 
response  time  for  a job  is  critical  it  is  not  desirable  to  design  a system  with  small  tasks 
and  hence,  high  spawning.  On  the  other  hand,  with  high  traffic  loads,  lost  tasks  can 
become  critical  due  to  the  queue  being  full  upon  arrival  of  a new  task.  In  this  regime,  high 
spawning  will  decrease  the  lost  task  rate  since  spawning  is  synchronized  with  a decrease 
in  queue  length  as  discussed  earlier. 

As  a matter  of  nomenclature  we  shall  refer  to  a newly  arriving  task  and  all  of  the 
spawned  tasks  that  have  originated  from  this  present  task  as  a job.  Therefore  the  job 
arrival  rate  is  the  external  task  arrival  rate,  X . Suppose  a task  spawns  k additional  tasks 
in  sequence  (that  is,  the  parent  task  spawns  a task  which  circulates  back  through  the  system; 
this  in  turn  spawns  another  task,  and  so  on  for  k times).  Then  we  can  write 


T T0  + Ti  + T2  + 


where  r is  the  service  time  for  the  parent  task  and  t i = 1,  2,  . . .k,  is  the  service 

0 ^ i 

time  for  the  i spawned  task,  t is  the  total  service  time  for  the  job.* 

k is  a discrete  random  variable  denoting  the  number  of  spawns  a parent  task  generates. 
Let  p (k)  be  the  probability  that  a parent  spawns  k tasks . Then  p(0)  = 1 - o and 

p(k)  = (1 -cx)cxk  k=0,  1,  2,  3...  (8-2) 


In  this  section  t.  denotes  the  service  time  for  a spawned  task  and  is  a random  variable, 
in  the  previous  section  we  used  the  notation  Tj  to  denote  the  mean  time  the  system  is  in 
state  i.  These  quantities  are  quite  different  and  should  not  be  confused. 
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The  mean  number  of  spawns  is 


k = 53  kp(k) 

k = 0 

= cr/(l  - j) 


(8-3) 


The  job  service  time  t,  given  by  Equation  (8-1),  is  the  sum  of  a random  number  of  random 
variables.  From  the  assumptions  of  the  model  each  r.  is  exponentially  distributed  with 
mean  l/u  : 


-**  T, 

(Ti>  e 01  i -0,  1,  2,  ...k 

Tj  > 0 


Therefore  the  characteristic  function  of  r.  is 


(8-4) 


*i<Zi>  - 


i = 0,  1,  2,  . . .k 


l r o 


To  find  f (t),  the  distribution  of  t,  we  have,  from  Bayes'  theorem, 


(8-5) 


f(T)  =53  fM  ■OPW 

k = 0 

and  the  characteristic  function  of  f(r)  is  given  by: 


(8-6) 


g(z)  = 53  g <*|  k)  P (k) 

1 _ A 


k = 0 


(8-7) 


But  f (r ( k)  is  the  distribution  of  t given  k,  thus  it  is  the  k-fold  convolution  of  f.(T).  Con- 

fch  ^ 

sequently  g (z  | k)  is  merely  g.(z)  raised  to  the  kl  power: 


*(zlk)  =(rfr 


(8-8) 
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Putting  Equations  (8-2)  and  (8-8)  into  (8-7)  yields 


g(z)  = 


^o(1-g) 
z - pq(1-ct) 


from  which  we  conclude  that  t is  also  exponentially  distributed: 


(8-9) 


-Mq  (1  -o)  t 


f(z)  = M0(l-^)  e 

Thus  the  mean  service  time  for  a job  is 


(8-10) 


HQ  (l-o) 


(8-11) 


External  jobs  or  tasks  arrive  at  the  system  at  a rate  Xq  and  the  average  work  that  arrives 
per  unit  time  is 


X T 
o 


M0d-^) 


(8-12) 


and  the  traffic  intensity  per  server  is 


p = — r 

Ko  s 


(8-13) 


Suppose  we  wish  to  study  the  effect  on  the  system  due  to  varying  the  spawn  probability 
a,  but  keeping  the  mean  job  service  time  7,  the  mean  job  arrival  rate  \q  and  the  number  of 
servers  s constant.  In  this  case  pQ  and  rQ  remain  constant.  For  example.  Figures  6-1 
and  6-2  show  plots  of  the  fraction  of  lost  tasks  L versus  pQ  for  different  values  of  cr,  s and  q. 
Letting  rQ  = Xq  t"  = 0.2,  q = s =2  and  pQ  = 0.1,  then  we  have  from  Figure  6-1: 

jo. 0164%  at  a = 0,  k = 0 
L =<0.0082%  at  a = 0.5,  Tc  = 1 
jO. 0016%  at  a = 0.9,  k = 9 

This  shows  the  effect  on  lost  tasks  by  partitioning  jobs  into  smaller  tasks.  The  case  a = 0 
implies,  from  Equation  (8-3),  that  k = 0,  that  is,  there  is  no  spawning  and  thus  the  mean 
task  size  is  equal  to  the  mean  job  size.  The  case  cr=  0.5,  k = 1 means  that  on  the  average 
the  job  requires  one  spawn,  i.e.,  the  average  task  size  is  half  the  average  job  size.  Simi- 
larly for  <7  = 0.9,  k = 9,  the  average  task  size  is  one  tenth  the  average  job  size,  thus 
requiring  nine  spawns. 
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